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Abstract 

We consider a generalization of representations of quivers that can be de- 
rived from the ordinary representations of quivers by considering a product of 
arbitrary classical groups instead of a product of the general linear groups and 
by considering the dual action of groups on "vertex" vector spaces together 
with the usual action. A generating system for the corresponding algebra 
of invariants is found. In particular, a generating system for the algebra of 
/S'0(n)-invariants of several matrices is constructed over a field of characteris- 
tic different from 2. The proof uses the reduction to semi- invariants of mixed 
representations of a quiver and the decomposition formula that generalizes 
Amitsur's formula for the determinant. 
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1 Introduction 

We work over an infinite field K of arbitrary characteristic. All vector spaces, 
algebras, and modules are over K unless otherwise stated. 

A quiver is a finite oriented graph. This notion was introduced by Gabriel in [TTj 
as an effective mean for description of different problems of the linear algebra. The 
importance of this notion from the point of view of the representational theory is 
due to the fact that the category of representations of a quiver is equivalent to the 
category of finite dimensional modules over the path algebra associated with the 
quiver. Since every finite dimensional basic algebra over algebraically closed field is 
a factor-algebra of the path algebra of some quiver (see Chapter 3 from [H]), the 
category of finite dimensional modules over such an algebra is a full subcategory of 
the category of representations of the quiver. Invariants of quivers are important not 
only in the invariant theory but also in the representational theory because these 
invariants distinguish semi-simple representations of a quiver. 

A representation of a quiver with / vertices consists of a collection of column 
vector spaces K'^^ , • • • , K'^'^ , assigned to the vertices, and linear mappings between 
the vector spaces "along" the arrows. We generalize this notion as follows. Let 
V, where 1 < f < /, be a vertex of the quiver. In the classical case GL{n^) acts 
on K"^^ but in our case an arbitrary classical group from the list GL{ny), 0(n„), 
Sp{ny), SL{n^), SO{n^) can act on /T"'". Moreover, we consider the dual space 
(/T"'")* together with K'^" in order to deal with bilinear forms together with linear 
mappings. Finally, instead of arbitrary linear mappings "along" arrows we consider 
only those that, for example, preserve some bilinear symmetric form on "vertex" 
spaces, etc. This construction is called a mixed quiver setting. The exact definition 
together with examples is given in Section 12. 1[ 

Orthogonal and symplectic representations of symmetric quivers, (super)mixed 
representations of quivers, and representations of signed quivers, respectively, in- 
troduced by Derksen and Weyman in [5|, Zubkov in [35], and Shmelkin in [28] . 
respectively, are partial cases of this construction (see part 3 of Example [1]). The 
motivation for these generalizations of quivers from the point of view of the repre- 
sentational theory of algebraic groups was given in [3], [2E], where symmetric and 
signed quivers, respectively, of tame and finite type were classified. 

In the paper we established generators for the invariants of a mixed quiver setting 
(see Theorem [1]). In particular, in Section IT2] we completed description, originated 
by Sibirskii in [29] and Procesi in [26], of generators for the invariants of several 
matrices under the diagonal action by conjugation of a classical group. 

The paper is organized as follows. 
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Section [2] is started with the definition of generahzed quivers and their represen- 
tations. It is followed by an overview of known results on generating systems for the 
invariants of quivers. 

Section [3] contains notations that are used throughout the paper. We also re- 
call some definitions from [24| such as a block partial linearization of the pfaffian 
(b.p.l.p.) and a tableau with substitution. 

In Section H] our main result (Theorem [T]) is formulated in terms of b.p.l.p.-s, 
where non-zero blocks are "generic" matrices. At the end of the section we consider 
the quiver with one vertex (Corollary [2]). This special case is of great importance 
since it is the simplest one and, roughly speaking, the general case can be reduced 
to it. 

Sections [3HH] are dedicated to the proof of Theorem [TJ In Section we show 
that elements from Theorem [1] are invariants (Lemma Hj). In Section [6] we rewrite 
generators of semi-invariants from [23| in terms of b.p.l.p.-s, and thus obtain a set 
generating the algebra of GL- and SL-invariants as a vector space over K (Theo- 
rem [2]). The general case is reduced to GL- and S'L-invariants in Section [7| by means 
of Frobenius reciprocity and the theory of modules with good filtration. In Theo- 
rem [7] we show that the space of invariants is the image of GL- and SL-invariants of 
an explicitly constructed quiver. In Section [8] we apply the decomposition formula 
from [21] to rewrite a b.p.l.p. as a polynomial in b.p.l.p.-s of a special form (The- 
orem [9]). Using this, in Section [9] we describe the image of GL- and SL-invariants 
and show that elements from Theorem [T] generate the algebra of invariants. 

2 Generalized representations of quivers 
2.1 Definitions 

A quiver Q = (Qq, Qi) is a finite oriented graph, where Qq = {1, . . . ,1} is the set of 
vertices and Qi is the set of arrows. For an arrow a, denote by a' its head and by 
a" its tail. Given a dimension vector n = {rii, . . . , n^), we assign an rij^-dimensional 
vector space to v E Qq. We identify K with the space of column vectors K"-" . 
Fix the standard basis e(f , 1 ),..., e(f, n^) for K'^", where e{v,i) is a column vector 
whose i-th entry is 1 and the rest of entries are zero. A representation of Q of 
dimension vector n is a collection of matrices 

h = {K)a^Q, eH = H{Q,n) = ir^^'X"^" ^ Homx(V;., V;0, 
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where i^"i^"2 stands for the hnear space of rii x n2 matrices over K and the iso- 
morphism is given by the choice of bases. We will refer to H as the space of repre- 
sentations of Q of dimension vector n. The action of the group 

G = GL{n) = Y[ GL{n^) 

veQo 

on H is via the change of the bases for Vy {v e Qo). In other words, GL{ny) acts 
on Vy by left multiplication, and this action induces the action of G on by 

9 ■ h = {ga'haga''^)aeQi, 

where g = iga)aeQi ^ G and h = {K)aeQi ^ H. 

The coordinate ring of the affine variety H is the polynomial ring 

K[H] = ^[4. 1 a e Qi, 1 < i < n«., 1 < j < n^"]. 

Here a;^ stands for the coordinate function on H that takes a representation h & H 
to the (i,j)-th entry of a matrix from X^a'^^a". Denote by Xq, = (x^) the 
n^/ X n^// generic matrix. 

Wc will use the following notation to define the action of G on K[H]. Given 
g E G, wc write g ■ for the matrix, whose (i,j)-th entry is g ■ xf-. Similarly, 
stands for the matrix, whose (i, j)-th entry is where $ is a mapping, 

defined on K[H]. 

The action of G on iJ induces the action on K[H\ as follows: {g-f){h) — f{g~^-h) 
for all g eG, f e K[H], he H. In other words. 



g ■ — ga' ^ag<x" 

for g( e G, q; e Qi. The algebra of invariants is 

K[Hf ^ {f e K[H]\g ■ f ^ f lor ^\\g eG}. 

Given a positive integer n, let us fix the following notations for the classical 
groups: 

0(n) = {Ae i^"^" I AA* = A'A = E}, Sp{2n) = {A e ii'2nx2n | ^tj^ ^ jy^ 
SO{n) = {A e 0{n)\ det(A) = 1}, where E = E{n) is the identity matrix, 

J = J{2n) = ^ E{n) ^q^'' ^ the matrix of the skew-symmetric bilinear 



form on K 



2n. 
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and for certain subspaces of K"^": 

S'^{n) = {A G K^^"" I A* = A] is tlic space of symmetric matrices, S^{n) = 
{A e X"^" I ^4* = — ^4} is the space of skew-symmetric matrices, L'^{n) — 
{A e X"X" I AJ is a symmetric matrix}, L'(n) — {A e K^^^ | is a skew- 
symmetric matrix}. 

The notion of representations of quivers can be generahzed by the successive 
reahzation of the following steps. 

1. Instead of GL{n) we can take a product G{n,g) of classical linear groups. 
Here g — (gr^, . . . ,grj is a vector, whose entries g^, . . . ,gi are symbols from 
the hst GL, O, Sp, SL, SO. By definition, 

Gin,g)= H G,, 
veQo 

where 



GL{n^), 


if 9v 


^GL 


O(n^), 


if 9v 


= 


Sp{n^), 


if 9v 


= Sp 


SL{n,), 


if 9v 


= SL 




if 9v 


= SO 



Obviously, we have to assume that n and g are subject to the following re- 
strictions: 

a) ii g^ — Sp {v e Qo), then Uy is even; 

b) if g^ is O or SO {v e Qo), then the characteristic of K is not 2. 

2. We can change the definition of G{n,g) in such a manner that allows us to 
deal with bilinear forms together with linear mappings. Since bilinear forms 
on some vector space V are in one to one correspondence with linear mappings 
from the dual vector space V* to V, we should change vector spaces assigned 
to some vertices to the dual ones. In order to do this consider a mapping 
i '■ Qo ^ Qo such that 

c) i is an involution, i.e., is the identical mapping; 

d) ni(^) = riy for every vertex v & Qq. 
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For every v E Qo with v < i{v) assume that Vi(y) = V*. Consider the dual 

basis e{v, 1)*, . . . , e{v, n^)* for V* and identify V* with the space of column 
vectors of length n^,, so e{v,i)* is the same column vector as e{v,i). 

The action of GLiji^) on K, induces the action on V* ^ which we consider as 
the degree one homogeneous component of the graded algebra Given 
Qv e GL{ny) and u e V*, we have 

9vu^ {g~yu. 

Hence, we should change the group G to 

G(n, g, i) = {g e G{n, g) \ g^^) = {g'^f for all v e Qo with v < i{v)}. 

Since the vector spaces and (X")* are isomorphic as modules over 0{ri), 
Sp{n), and SO{n), we assume that 



e) if is O, Sp or 5*0 {v G Qo), then i{v) 



V. 



3. Instead of the space H{Q,n) we should take its subspace H[Q,n,h), where 
h = {hajaeQi IS a symbol from the list M, S~^, S~ , L+, L~ . By defini- 

tion, 

H{Q,n,h)= 0i/„, 

a€Qi 

where 

' fsf^^'X^c", if /i„ = M 

if/la = ^+ 

Hr^— I S~{na'), if ha — S~ . 

L^{na'), if = 
L-(na'), if /la = L- 

Additionally, we have to assume that n and h are subject to the restriction: 

f) if h-a 7^ M (a G Qi), then n«' = ria". 

Consider a group G = G{n,g,i) C G{n) and a vector space H = H{Q,n,h) C 
H{Q,n) satisfying the previous conditions a)-f). To ensure that these inclusions 
induce the action of G on H, we assume that the following additional conditions are 
also vahd for all G Qo, o; G Qi: 



g) if a is a loop, i.e., a' = a", and ha is 5*+ or 5* , then g^, is O or SO; 
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h) if a is a loop and ha is or L , then g^' = Sp; 

i) if a is not a loop and 7^ M, then 1(0;') = a" and /Iq, is 5"+ or S~ . 

A quintuple O. = {Q,n, g, h,i) satisfying a)-i) is called a mixed quiver setting. 
Definitions of the generic matrices Xa and the algebra of invariants K[H]'-^ are the 
same as above. Note that if ha = S~^, then = Xa] if ha = S~ , then X^ = —Xa] 
if ha = , then (X^J)* = XaJ] and if ha = L~ , then (X^J)* = —XaJ- In this 
paper we establish a generating system for K[H]'~^ . 

Example 1. 1. Let Q be the following quiver 




Define a mixed quiver setting O. = {Q,n,g, h, i) by rii = n2 = n, gi = g2 = GL, 
ha = hp = 5"+, and i(l) = 2. The group G{n, g, i) ~ GL{n) acts on H{Q, n, h) = 
S~^{n) © S'^{n) by the rule 

g-iA,B) = igAg\gBg') 

for g G GL{n) and (A, -B) G ^^(n) © S'^(n). Hence the orbits of this action corre- 
spond to pairs of symmetric bilinear forms on K"^. If we put ha = hp = S~ , then we 
obtain pairs of skew-symmetric bilinear forms on K"^. The classification problem for 
such pairs is a classical topic going back to Weierstrass and Kronecker (see [20] , [21] , 
and [18J). 

2. Let Q be the following quiver 



Define a mixed quiver setting = {Q,n, g, h,i) by ni = n2 = ns = m; 
9i = 92 = 'S'L, = O] ha = h^ = M, h,/? = S*"*"; and i(l) = 2, i(3) = 3. Hence 
the action of G(n, g, i) ^ SL{n) x 0(m) on n, h) = JT"^™ © S+{n) © iT'"^" 

is given by 

[g, f) ■ (A, 5, C) = ((7^/*, \ fCg') 

for /) G SL{n) x 0(m) and (A, 5, C) G fsT"^™ © S+{n) © 

3. If we consider mixed quiver settings = {Q,n,g,h,i) with the restriction 
g^ G {G-^v, O, Sp} for all f G Qo, then we obtain the definition of supermixed repre- 
sentations of a quiver (see [35]), or, equivalently, the definition of representations of 
a signed quiver (see [25]). 
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2.2 Known results 

In this section {Q,n, g, h,i) is a mixed quiver setting, G = G{n,g,i), and H = 
H{Q,n, h). We overview the known resuhs on generators and relations between 
them for the algebra of invariants K[H]'^. 

The first results on invariants of quivers (i.e. for the identical involution i) were 
obtained for an important special case of a quiver with one vertex and several loops. 
For a field of characteristic zero generators for G G {GL{n), SL{n), 3p{n)} were 
described by Sibirskii in [29] and Procesi in [26]. Procesi also described relations 
between generators in [26] applying the classical theory of invariants of vectors and 
covectors (see book [3T] by Weyl). Independently, relations for G = GL{n) were de- 
scribed by Razmyslov in [27]. Developing ideas from [26j, Aslaksen et al. calculated 
generators for G = SO{n) (see [2]). 

Invariants for an arbitrary quiver Q were considered by Le Bruyn and Procesi 
in [22], where generators were found for the case of G = rit,gg„ GLijin) and H = 
YlaeQi K^°''^"'"" ■ Similar results were obtained later by Domokos in [6J. 

The importance of characteristic-free approach to quiver invariants was pointed 
out by Formanek in overview [I6] (see also [IS]). Relying on the theory of modules 
with good filtrations (see [9j), Donkin described generators for a quiver with one 
vertex in [11] and for an arbitrary quiver afterwards (see [I3]). Relations between 
generators from the mentioned papers were found by Zubkov in [32] and [34] by 
means of an approach that allowed to calculate generators and relations between 
them simultaneously. His method is also based on the theory of modules with good 
filtrations. 

For the rest of classical groups over a field of positive characteristic, the first 
results were obtained by Zubkov. In |33] he obtained generators for a quiver with 
one vertex and the orthogonal or symplectic group G. The proof is based on ideas 
from [TTj and a reduction to invariants of mixed quiver settings with = GL 
for every vertex v. The reduction was performed by means Frobenius reciprocity. 
Let us recall that we do not consider the case of the (special) orthogonal group 
in characteristic 2 case. The reason is that in the later case even generators of 
invariants of several vectors are not known (for the latest developments see [8]). 

Invariants of a quiver under the action of G = JH^^gQ^ SL{n^) are called 
semi-invariants. Its generators for an arbitrary characteristic were established by 
Domokos and Zubkov in [Tj using the methods from [11], [13], [32], [M], and, inde- 
pendently, by Derksen and Weyman in [3] , [3] utilizing the methods of the represen- 
tation theory of quivers. Simultaneously, similar result in the case of characteristic 
zero was obtained by Schofield and Van den Bergh in [5U]. These results were gen- 
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eralized for mixed quiver settings with g^, = SL and ha = M, where w is a vertex 
and a is an arrow, by the author and Zubkov in [23]. 

Zubkov in f35] combined the arguments for Young superclasses from [13] with the 
reduction from |23j to describe generators for a mixed quiver setting {Q,n, g, h,i) 
with g^ G {GL, O, Sp} for all v G Qo- Relations between them were found in [35] . 

Generators for the remaining mixed quiver settings are computed in this paper. 

3 Preliminaries 

3.1 Notations 

In what follows, N stands for the set of non-negative integers, Z for the set of 
integers, and Q for the quotient field of the ring Z. 

The cardinality of a set S is denoted by #5* and the permutation group on n 
elements is denoted by iS„. Given integers i < j, we write [i,j] for the interval 

+ 1, . . . , j - 1, j. 

By a distribution B = {Bi, . . . ,Bs) of a set [l,t] we mean an ordered partition 
of the set into pairwise disjoint subsets Bi {1 < i < s) , which are called components 
of the distribution. To every B we associate two functions j i— > B\j\ and j ^ B{j) 
(1 < j < t), defined by the rules: 

B\j\ = 2, if J e S„ and B{j) = n B,\j G B,}. 

A vector t = (ti, . . . ,ts) G N'^ determines the distribution T = (Ti, . . . ,Ts) of 
the set [1, t], where t = ti + ■ ■ ■ + tg and Tj = {ti + ■ ■ ■ + tj.i + 1, . . . , ti + ■ ■ ■ + t^}, 
1 <i < s. As an example, if t = (1, 3, 0, 2), then T = ({1}, {2, 3, 4}, 0, {5, 6}) and 
T|5| = 4. 

A vector A = (Ai, . . . , A^) G N** satisfying Ai > ■ ■ ■ > A<j and Ai + ■ ■ ■ + As = t is 
called a partition of t and is denoted by A h t. A multi-partition A h t is a g-tuple 
of partitions A = (A^, . . . , A^), where A^^ h ti, . . . , A^ h tq, and t= {ti, . . . ,tg) G W. 

3.2 PfafRans and tableaux with substitutions 

Denote coefficients in the characteristic polynomial of an n x n matrix X by ak{X), 
i.e., 

det{XE -X) = A" - ai(X)A"-^ + • ■ ■ + (-1)"(t„(X). 
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Assume n is even. Define the generalized pfaffian of an arbitrary n x n matrix 
X = (xij) by _ 

pf(X)=pf(X-X*), 

wliere pf stands for the pfaffian of a skew-symmetric matrix. By abuse of notation 
we will refer to pf as the pfaffian. For K = Q there is a more convenient formula 

_ 1 

pf(X) = pf(X - X*) = — — sgn(7r) JJx^(2i_i),^(2i). (1) 

^ ' 7re5„ i=l 

For n X n matrices Xi = (xjj ( 1) ),..., = (xjj(s)) and positive integers 
ki, . . . , ks, satisfying ki+- ■ ■+ks = n/2, consider the polynomial pf + - ■ ■+XsXs) 
in the variables Xi,...,Xs. The partial linearization pf;^^ j^^{Xi, . . . , Xg) of the 
pfaffian is the coefficient at Xi^ ■ ■ ■ x'^" in this polynomial. Assume that for some 
n = {ui, . . . , nm) G with ni + ■ — h = n each of matrices Xi, . . . , X^ is parti- 
tioned into m X m number of blocks, where the block in the (i, j)-th position is an 
nj X nj matrix and the only non-zero block is the one in the (p, g)-th position. Then 
pffci fcs("^i' • • • ' -^s) is called a block partial linearization of the pfaffian (b.p.l.p.). 

The following notions were introduced in Section 3 of p^, where more detailed 
explanation and examples are given. 

Definition (of shapes). The shape of dimension n = (ni, . . . ,nm) G N"^ is the 
collection of m columns of cells. The columns are numbered by 1,2, ... ,m, and 
the i-th column contains exactly Ui cells, where 1 < i < m. Numbers 1, . . . ,ni are 
assigned to the cells of the i-th column, starting from the top. As an example, the 
shape of dimension n = (3, 2, 3, 1, 1) is 



1 2 3 4 5 



1 


1 


1 


1 


1 


2 


2 


2 






3 




3 







Definition (of a tableau with substitution). Let n = (rii, . . . , G N'" and 

let n = ni + ■ ■ ■ + TT-m be even. A pair (T, (Xi, . . . ,Xs)) is called a tableau with 
substitution of dimension n if 

• T is the shape of dimension n together with a set of arrows. An arrow goes 
from one cell of the shape into another one, and each cell of the shape is either 
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the head or the tail of one and only one arrow. We refer to T as tableau of 
dimension n, and we write a G T for an arrow a from T. Given an arrow 
a ^ T, denote by a' and a" the columns containing the head and the tail of a, 
respectively. Similarly, denote by 'a the number assigned to the cell containing 
the head of a, and denote by "a the number assigned to the cell containing the 
tail of a. Schematically this is depicted as 



a" a' 







a' 





• (y9 is a fixed mapping from the set of arrows of T onto [1, s] that satisfies the 
following property: 

ii a,b eT and (p{a) = ip{b), then a' = b', a" = b"; 

• {Xi, . . . , Xs) is a sequence of matrices such that the matrix X^pi^a) assigned to 
the arrow a G T is Ua" x Ua' matrix and its (p, q)-t}i entry is denoted by (^Xj)pq. 

Example 2. Let T be the tableau 



a 


b 






c 




d- 







of dimension (3,3,2). Define ip by 99(a) = 1, 99(6) = 99(c) = 2, and ip{d) = 3, and 
let Xi, be 3 X 3 matrices and be a 3 x 2 matrix. Then (T, {Xi, X2, X^)) is a 
tableau with substitution. 

Definition (of bpfy(Xi, . . . , Xg)). Let (T, (Xi, . . . , X^)) be a tableau with substi- 
tution of dimension n. Define the polynomial 

bpf°(Xi,...,x,)= 

Sgn(7ri) • • •Sgn(7r,„) JJ(^¥'(a))7r„„("a),7r„,('a), (2) 

and the coefficient 

s 

CT^\[H(^eT\ip{a)^j}\ 
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In the case K = Q define 

bpf^(Xi, . . . ,X,) = -bpf° (Xi, . . . ,X,). 

Ct 

Since bpf2.(Xi, . . . , X^) is a polynomial in entries of Xi, . . . , X^ witli integer coeffi- 
cients, the definition of bpf'p(Xi, . . . , Xg) extends over an arbitrary field. 

Example 3. For every n x n matrix X there is a tableau with substitution (T, X) 
such that det(X) = bpfy(X). If n is odd, then the same is valid for pf(X) (see 
Example 2 of [2A\ for details). 

The next lemma, which is part b) of Lemma 1 from [23], shows that bpf is a b.p.l.p. 

Lemma 1 Let (T, (Xi, . . . ,Xs)) be a tableau with substitution of dimension n = 
(ni, . . . ,72^)- Consider G T such that (f{ai) = 1, . . . , <f{s) = s. For any 

1 < p < s denote by Zp the n x n matrix, partitioned into mx m number of blocks, 
where the block in the (i, i)-th position is an rii x rij matrix; the block in the (a^, a'p)-th 
position is equal to Xp, and the rest of blocks are zero matrices. Then 

bpfy(Xi,...,X,) = ipf;.^^ 

where kp = #{a G T | {p{a) = p} for any I < p < s. 

4 Generators 
4.1 Main results 

Let = {Q,n,g, h, i) be a mixed quiver setting and Qo = {!,...,/}. Without loss 
of generality we can assume that 

if V G Qo and is GL or SL, then i{v) ^ v. (3) 

Otherwise we can add a new vertex v to Q, and set i{v) =v,n^ = = g^; this 

construction changes neither the space H{Q, n, h) nor the algebra of invariants. 

Definition (of the mixed double quiver setting £2^). Define the mixed double 
quiver setting £3^ = {Q^,n,g,h'^ ,i) as follows: = Qo, Qf = Qi 1J{"* I " e 
Qi, ho, = M}, where (a*)' = i{a"), (a*)" = i{a'), and h^t = M for a G Qi with 
ha = M and h^ = h^ for all a G Qi. 

Define a mapping <l>^ : K[H{Q^, n, h^)] K[H{Q, n, h)] such that $^(X„) = 
Xq for a G Qi, and ^^{Xa^) for a G Qi and ha = M is defined as follows: 
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• If g^, + Sp and g^. ^ Sp, then <l>^(X,0 = X*. 



• If g^, = Sp and c/„„ ^ ^, then $^(X„t) = X* J(n„/). 

• If 7^ ^ and c/„„ = ^, then $^(X„t) = J(n^//)X*. 

• If gf^/ = Sp and = Sp, then $^(Xot) = J(na//)X*. 



Let us remark that the meaning of notation $'^(Xo) was explained in Section [2711 
Example 4. Let Q be 



(ir '® © 

Define a mixed quiver setting O = {Q,n,g,h,i) by i(l) = 2, i(3) = 4, 1(5) = 5; 
9i=92 = GL, g^ = g^ = SL, g^ = O; = = hs = M, hp = S+. Then is 



Before presenting the next concept, let us recall that a = ai ■ ■ - a^ is a path in 
Q (where ai, . . . , G Qi), if a[ = ag, . . . , = a^'. The head of the path a is 
a' = a'^ and the tail is a" = a'{. The path a is called dosed if a' = a" . 

Definition (of a 0-tableau with substitution and a path H-tableau with 
substitution). A tableau with substitution (T, (Yi, . . . , Yg)) of dimension n G N*" 
is called a £l-tahleau with substitution, if for some weight w = (wi, . . . , wi) E W and 
the distribution W, determined by w (see Section [311) . we have 

m n = (ni, . . . ,ni, . . . ,ni . . .,ni); 



• if a G T, then there exists an a G Qi such that V^(a) = X^, W\a'\ = 
W\a"\ = a'. 

If we replace the last condition by the following one 



a 
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• a a E T, then there exists a path a = ai ■ ■ ■ ar Q (where ai, . . . ,ar G Qi) 
such that = ■ ■ -Xq.^, W\a'\ = i{a"), W\a"\ = a', 

then we obtain the definition of a path £l-tableau with substitution. Obviously, for 
a (path) O-tableau with substitution (T, (Yi, . . . , Yg)) we have bpfj.(Yi, . . . , Yg) G 
K[H{Q,n,h)]. 

Theorem 1 (Main theorem) Let {Q,n, g, h,i) be a mixed quiver setting sat- 
isfying ij^. Then the algebra of invariants K[H(Q,n,h)]'^^'^'^''^^ is generated as 
K-algebra by the elements $^(crfc(X/3^ ■ • -X^J), {h\iij,{Yi, . . . ,Ys)), where 

1. (3i - ■ ■ I3r ranges over all closed paths in and I < k < Tij^n; 

2. (T, (Yi, . . . , Yg)) ranges over all path -tableaux with substitutions of a weight 
w_ such that 

9v ^ {GL, O, Sp} for some v G Qq, then w^y) = = 0; 

b) if Qv = for some v E Qq, then Wi{^i,) = or = 0; 

c) if dv = SO for some v G Qo, then < 1 and i{v) = v. 

This theorem imphes the main result of [35] . 

Corollary 1 Let {Q,n, g, h,i) be a mixed quiver setting satisfying If g^ G 
{GL,0,Sp} for all v G Qq, then K-algebra K[H{Q,n, h)]^^'^'^'''^ is generated by 
$-^(crA;(X^^ ■ ■ -X^J), where (3i - ■ ■ (3^ is a closed path in and 1 < k < ripn. 

For / G K[H{Q, n, h)] let t = {ta)a£Qi G N*^^ be the multidegree of /, i.e., ta is 
the total degree of the polynomial / in xfj, where 1 < i < n^/ and 1 < j < n^//. The 
algebra of invariants is homogeneous with respect to the grading by multidegrees as 
well as the generating system from Theorem [TJ 

4.2 Invariants of several matrices 

Consider the case of a quiver with one vertex and d loops. Let = M for every 
arrow a. Then H = K^^"- ... j^nxn -g g^.^uple of n x n matrices over K, and G 
is a group from the list GL{n), 0{n), Spin), SO{n). We assume that if G is 0{n) 
or SO{n), then the characteristic of K is nor 2; if G is Sp{n), then n is even. The 
group G acts on H by the diagonal conjugation. Hence it acts on K[H] as follows: 
g ■ Xa = g~^Xag, where g E G, 1 < a < d, and Xq, = (xfj) is the n x n generic 
matrix. We do not consider the case G = SL{n) because invariants for GL{n) and 
SL{n) are the same. 
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Corollary 2 The algebra of invariants K[H]'^ is generated by the following ele- 
ments: 

a) (Tk{X) (1 < k < n and X ranges over all monomials in Xi, . . . ,Xd), if G = 
GL{n); 

b) ak{Y) (l<k<n), zfG = 0{n); 

a) (Jk{Y) (I < k < n), if G = SO{n) and n is odd; 

d) ak{Y), ^fc,,„„fcjFi, ...,Ys) (l<k<n,k^ + --- + ks = n/2), tf G = SO{n) 
and n is even. 

In b), c), and d) matrices y, Fi, . . . , range over all monomials in Xi, . . . , X^, 
11- ■ ■ J^d- 

e) (Jk{Z) (1 < k < n and Z ranges over all monomials in Xi,...,Xa, 
JX{J, . . . , JX*j;, ifG = Spin). 

Proof. It follows immediately from Theorem [TJ To prove part d) we should also 
use the fact that bpfT(Yi, . . . , Fg) is a partial linearization of the pfaffian for one 
column tableau T (see part 1 of Example 2 from |24j). □ 

The only new part of Corollary [2] is part d) (see Section f272\ for references). 

5 Action of groups on tableaux with substitutions 

In this section we show that the elements from Theorem [1] are invariants. 

Consider an ri G and the group G = YYiLi GLijii). Given g = {gi)i<i<m £ G 
and a tableau with substitution (T, (Yi, . . . ,Ys)) of dimension n, define the tableau 
with substitution {T, {g * Yi, . . . , g * Y^)) hj g *Yj = ga"Yjgl^,, where I < j < s and 
a G T is such that f{a) = j. Since for all a,b & T with (p{a) = ip{h) we have a' = b' 
and a" = b", the matrix g *Yj is well defined. 

Lemma 2 Using the preceding notation we have the equality 



hpfrpig *Yi,...,g*Ys) = det{gi) ■ ■ ■ det(5(™)bpf j.(Fi, . . . , K,)- 



A.A. LOPATIN 



16 



Proof. Let n = rii + ■ ■ ■ + rim and let go he an n x n block-diagonal matrix such 
that the i-th block is equal to Qi [1 < i < m). By the definition of T, n is even and 
{cp{a)\aeT} = [l,s]. 

Repeat construction from Lemma [TJ Consider ai, . . . , G T such that (p{ai) = 
1, . . . , (p{s) = s. For any 1 < p < s denote by Zp the n x n matrix, partitioned 
into m X m number of blocks, where the block in the (z, j)-th position is an rii x rij 
matrix; the block in the (a^', ap)-th position is equal to 1^, and the rest of blocks 
are zero matrices. Then bpf2-(Yi, . . . , Ys) = gpf^^ • • • ? Zg), where q = ±1, 

kp = #{a G T I ip{a) = p} for any I < p < s. Thus, 

bpfr(c/ *Yi,...,g*Ys) = qpfku...,ksi9oZigl, • • • , c/o^s^o) 

= 9det(^o)pffci,...,fc,(^i, • • • , Zs), 

since pf (^fo-^^^'o) — det(5'o)pf (-Z^) for every n x n matrix Z. This completes the proof. 
□ 

Lemma 3 Let {Q,n,g,h,i) be a mixed quiver setting that satisfies ^ and Qq = 
{1, . . . , /}. Let (T, (Yi, . . . , Ys)) be a 0.-tableau with substitution or path ^.-tableau 
with substitution of a weight w = {wi, . . . , wi). Assume that = for all v E Qq 
with = Sp. Then for all g = {gv)veQo ^ G{n,g, i) we have 

g-hpiAY^,...,Ys) = qhpfAYi,...,Ys), 

where 

g= J] det((7.)-"''' H det{g,)'^^(^^-''\ 

vGQo,v=i(v) vGQo,v<i{v) 

Proof. a) Assume that (T, (Yi, . . . ,Ys)) is a H-tableau with substitution. Let 
w = wi + ■ ■ ■ + wi and let W be the distribution determined by w. Define a mapping 
: G{n,g,i) YY^=iGL{nw\j\) by -^{g) = (V^(^)i, . . . , and ilj{g)j = gw\j\ 

for 1 < j < w. We claim that 

g-hpiT{Yi,...,Ys) =hpiT{tlj{g'')*Yu...,^{g-^)*Ys) for any ^ G G{n,g,i). (4) 

By the definition of a l}-tableau with substitution, for every a E T there exists an 
arrow a G Qi with V'^(a) = ^a, W\a'\ = i{a"), and iy|a"| = a'. Hence g ■ 5^^(a) = 
g ■ Xa = g^}Xaga"- On the other hand, il){g~'^) * F^(a) = i){g~'^)a"Xa'4){g~'^)\, = 
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9w\a"\^^i9w\a'\y = = dj^a^ga", siiice = {gJY for g^„ ^ Sp. 

Therefore g ■ 5^^(a) = "^{g^^) * '^'pia) and (jlj) is proven. 

Equality (jlj) together with Lemma [2] completes the proof. 

b) Let {T, {Yi, . . . ,Ys)) be a path H-tableau with substitution. Observe that 
for any g G G{n, g, i) and a path a = ai ■ ■ ■ in Q we have g ■ X^^ ■ ■ ■ Xa^ = 
g^,^ ■ Xa^ ■ ■ ■ Xa^ ■ ga". Use this remark and the proof of part a) to obtain the claim. 
□ 

Lemma 4 The elements from Theorem [I] are invariants. 

Proof. We claim that g ■ $^(X^) = $^(^ • Xp) for all g E G{n, g, i) and (3 E Qf . 
For V E Qo set 

^ ^ f J(n^), ifg^ = Sp ^ ^ f -1, if9v = Sp 
\ E{ny), otherwise ' ^ I otherwise 

Then for every G Qo we have 

9iiv) = Uvig^yiv (5) 

There are two cases. 

. If /? G Qi, then g ■ $^(X^) = g ■ X^ = <l>^{g ■ X^). 

. If /3 = a* for a G Qi, then g ■ <I>^(X^) = g ■ (VX*/„0 = Ia"{g-'X^g^.yi^,. 
On the other hand, ^^{g ■ Xp) = ^'^{g~}Xpgpn) = gT^^„^I^nXl^I^,gi(^a,). For- 
mula dS]) shows that g ■ = $^(^ ■ Xp). 

Therefore g ■ ^'^{Xp) = ^^{g ■ Xp) and, consequently, g ■ $^(/) = ^^{g ■ f) for 
every / G K[H{Q^ ,n,h^)]. Obviously, for a closed path /?i ■ ■ ■ /^r in and 
1 < A; < the element akiX/s^ ■ ■ ■ Xfs^) E K[H{Q^ ,n,h^)] is a G{n,g,i)- 

invariant. This remark together with Lemma [3] concludes the proof. □ 



6 GL- and S'L- invariants of quivers 

Let 13 = {Q,n,g, h, i) be a mixed quiver setting satisfying ([3]) and G = G{n,g, i), 
H = H{Q,n, h). Throughout this section we assume that g^ is GL or SL for all 
V E Qo and = M for all a E Qi. 
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Definition (of 0^). Define a mixed quiver setting O.^ = (Q^, n, g, h^, i) togetlier 
witli a mapping <l>^ : K[H{Q^, n, h^)] K[H] as follows. (Here tfie letter L stands 
for tlie word loop). Let Qq = Qq, Q\ = Qi Y[{ay \ v G Qq, v < i{v)}, wliere a„ is a 
loop in the vertex v. For an a G Qi define = ha and ^^{Xa) = X^, for v E Qo 
with V < i{v) define h^^ = M and $^(X«J = E(n„). 

It is not difficult to see that g ■ = ^^{g ■ Xp) for all G G and (3 G Qf . 

Therefore 

^ . $^(/) = $^(^ . /) for all / G n, /i^)] (6) 



Theorem 2 Lei £3 = {Q,n, g, h,i) be a mixed quiver setting satisfying where 
g^ is GL or SL for all v E Qo and = M for all a E Qi. Then the algebra of 
invariants K[H]^ is spanned over K by the elements ^^{hpfj^lYi, . . . ,Ys)), where 
(T, (Yi, . . . , Ys)) is a O.^ -tableau with substitution of a weight w and wi^y) = Wy for 
all V E Qo with g^ = GL. 

The proof is organized as follows. The semi-invariants, i.e., the invariants for the 
case of g^ = SL for all v E Qo, has been calculated in [23], where the case of an 
arbitrary quiver setting was reduced to a zigzag quiver setting, and for zigzag quiver 
settings generating systems for semi-invariants were described. We start by rewriting 
these results in the language of tableaux with substitutions (see Sections 16.11 16.21) . 
Afterwards it is just an exercise to reduce GL- and SL-invariants to semi-invariants 
(see Section [6T3|) . 

6.1 Semi- invariants of zigzag quiver settings 

The following two definitions are taken from \23\ . 

Definition. A quiver Q is called bipartite, if every vertex is a source (i.e. there is 
no arrow ending at this vertex), or a sink (i.e. there is no arrow starting at this 
vertex). A quiver setting {Q,n, g, h,i) is called a zigzag quiver setting, if 

• Q is a bipartite quiver, g^ is SL for all v E Qo and ha = M for all a E Qi, 

• for every vertex f G Qo we have i{v) ^ v; moreover, if f is a source, then i{v) 
is a sink and vice versa; 

• there is no arrow a E Qi with a' > *(«') and a" > i{a"). 
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Assume that {Q, n, g, h, i) is a zigzag quiver setting. Hence Q can be schemat- 
ically depicted as follows. 

h+k+l • 
2I1 + I2 • 

h + l • 
h + k • 

Here 

• Qq = {1,..., 2/1 + 2/2} and 
Qi = {«(!),..., a(di),/3(l),. 

• the arrows «(!), . . . , a{di) go from the vertices /i + 1, . . . , /i + /2 to the vertices 
1, . . . , /i; the arrows f3{l), . . . , (3{d2) go from li + 12 + 1, ■ ■ ■ ,2li + 12 to 1, .... /i; 
and the arrows 7(1), ... , 7(^3) go from /i + 1, . . . , /i -I-/2 to 2/i -I-/2 + 1, • • • , 2/i + 

2/2; 

• the involution i permutes vertices horizontally; consequently ni(^) = for all 
ve{l,...,2h + 2l2}. 

Fix t = {ti, . . . ,tdj, r = (ri,...,rdj, s = {si, . . . , Sa-^) and denote by 
K[H]{t,r, s) C K[H] the space of polynomials that have a total degree tk in vari- 
ables from Xa(k) (1 < ^ < <^i), a total degree in variables from (1 < A; < ^2), 
and a total degree in variables from ^-y(fe) (1 < k < ^3). Further, let T,R,S, 
respectively, be the distributions determined by r, s, respectively, and denote 
t = H h tdi, r = ri H h r^j, s = si H h s^g. 

Definition. Let A — (Ai, . . . , Ap) be a distribution of the set [1, t + 2r] and let 

B = {Bi, . . . , Bq) be a distribution of the set [1, t + 2s]. The quintuple (t, r, s. A, B) 
is called admissible if there are p = (pi, . . . G N'^ g = {qi, . . . , qi.J G N'^ such 
that for p = pi + ■ ■ ■ , q = qi + ■ ■ - + ^12 and for the distributions P, Q, determined 
by p, q, we have = np\j\ (1 < j < p), #5^ = Hqui+i^ (1 < J < g), 



/3(l),-,/3(d2) 



a(l),...,a(di) 
/ 

7(1),. ..,7(^3) 



2Zi + Z2 + 1 



• 2^1 + 2/2 



,/3(d2),7(l),---,7(c?3)}; 



U Tfe U + U (i + r + i?fc)= U Aj, 

l<k<di,a{kY=i \<k<d2,l3{k)'=i l<k<d2, l3{k)"=i(i) l<j<P,P\j\=i 
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where 1 < i < h, and 

U n U (t + Sk) U {t + s + Sk)= \j B„ 

l<k<di,a{k)"=i l<k<d-i,^{k)' =i(i) l<k<di,^{k)" =i l<j<q,Q\j\=i-h 

where /i + 1 < i < /i + /2- In particular, Yl^l^i ''^iPi = t + 2r, Yl''i=h+i "^ili-h = i + 2s. 
A pair (p, q) is called a weight. 

The definition of the poljTiomial DPf^^ G r?^) for admissible quin- 

tuple (t, r, s, A, 5) can be found in Section 5.2 of [23j. This polynomial is the block 
partial linearization of the DP, where DP was introduced in [23] as the mixture of 
the determinant and the pfaffian. (Note that DP is also a b.p.l.p., see part 4 of 
Example 2 from [23].) By Proposition 3 from [23j, in the case = Q we have 

DP_4; = ^ E E ^^'^(-1'-^)' (7) 

where F^'^(ri,r2) is 

t r s 

Sgn(ri) ^S^{'r2)Y\_^A(li{i)),B(T2{i)) Y\.yMri{t+j)),A{Ti{t+r+j)) n^J(rl(t+fc)>,B(r2(t+s+fc)) 
i=l j=l k=l 

and the constant c E Z depends on the quintuple. Moreover, all coefficients in DP^ ^ ^ 
belong to Z, if the characteristic of K is zero, and they belong to Z/(char ii')Z, if 
the characteristic of K is positive. Hence using ([7]), we can define DPf;^ over an 
arbitrary field. Now we can formulate Theorem 2 of [23] . 

Theorem 3 If a space K[H]{t,r, s)^ is non-zero, then the triplet {t,r,s) is admis- 
sible. In this case K[H]{t,r, s)'^ is spanned over K by the set of all DPJ^^^ for all 
admissible quintuples (t, r, s, A, B) . 

Construction. Let (t, A, i?) be an admissible quintuple of a weight {p,q). De- 
fine n = ( ni, . ..,ni , rii^, . ,n;^^ , n^^+i, . ,n;^+i , . . . , ni^+i2, ■ ,n;^+;J . Con- 
pi pii 91 qi2 
struct a tableau with substitution {D, {Zi, . . . , Zh)) of dimension n as follows. Ar- 
rows of D are {oj, bj, Ck\l < i < t, 1 < j < t, 1 < A; < s}, where 

• "oj = a'{ = A\i\, 'ai = B{i), a- = B\i\ +p; 
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. "bj = A{t + j), y\ = A|t + il, % = A(i + r + i), = A|i + r + J I; 

• "cfc = B{t + k), 4 = B\t + k\ +p, 'ck = B{t + s + k), 4 = B\t + s + k\ + p. 

Define ip{-) in such a way tiiat {99(0,) | a G -D} = [1, /?] for some h > and for any 
1 < ii < i2 ^ t, 1 < ji < j2 < r, 1 < ki < k2 < s we have 

• = if and only if <^ = a^^, <^ = af^, T|ii| = Tjisl; 
. (^(6,J = if and only if b'^^ = 6;^, 6^^ = 6^^, R\n\ = R\j2\; 

• ¥'(cfei) = <^(cfej if and only if = 4\ = c'4, ,5|A;i| = ,5|A;2|. 
Define matrices Zi, . . . , Zh hj 

for 1 < i < 1 < j < r, 1 < /c < s. We say that (_D, (Zi, . . . , Zh)) is the tableau 
with substitution that corresponds to {t,r, s, A, B). 

Lemma 5 Let {D, {Zi, . . . , Zh)) be the tableau with substitution, of dimension n, 
that corresponds to an admissible quintuple {t, r, s, A, B) of a weight {p, q) . Then 

a) {D, {Zi, . . . , Zh)) is well defined; 

b) {D, {Zi, . . . , Zh)) is a £l-tahleau with substitution with the weight w — 

{pi,...,Pi„ 0,...,o, eN2^i+2'^- 

c) bpfB(Zi,...,Z,)=±DPg. 

Proof, a) We claim that Xa(T\i\) is an Ua'^ x Ua'. matrix for 1 < i < t. In other words, 
we should prove n^v = na(T\i\y and Ua'. = ■n-a(T|i|)"- Admissibility of {t,r,s,A,B) 
implies that P\A\i\\^ Q;(T|i|)' and Q\B\i\\ + h ^ a{T\i\)". Thus 

n-a'/ = tT-Aiii = '>^p\A\i\\ = '>T'a{T\i\Y and 

n-ar = nB\i\+p = riQ\B\i\\+h = ■"'a(r|i|)"- 

Similarly, we can show that Xf^(^R\j^^ is an x ny. matrix for any 1 < j < r and 
X^(^s\k\) is an ric'^ x ric'^ matrix for any 1 < A; < s. 
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It is not difficult to see that each cell of D is the head or the tail of one and only 
one arrow. The claim follows. 

b) This part of the lemma is straightforward. 

c) Construct multi-partitions 7^^^ l~ i, ^max ^max ^5 respectively, using 
{t,r, s, A, B) (see part (iii) of Definition 3 from [2^) and let they determine the 
distributions Tmax, ^max, ^max, respectively. It is not difficult to see that cd = 
ihSv^a. i^^Ama. Ama. = ±c. Formuk ([7]) coucludes the proof over the field Q 
which extends to the case of an arbitrary field. □ 

The following result is a consequence of Theorem [3] and Lemmas [3l [51 

Theorem 4 Let {Q,n,g,h,i) be a zigzag quiver setting. Then the algebra of 
invariants K[H]^ is spanned over K by the elements hpij;){Zi,...,Zh), where 
{D, {Zi, . . . , Zh)) is a 0.-tableau with substitution. 

Let us remark that under the given restrictions on H the generating set of Theorem H] 
is smaller than that of Theorem [2j 

6.2 Semi-invariants of arbitrary quivers 

Consider a mixed quiver setting £3 = {Q,n,g,h,i) such that Q is an arbitrary 
quiver, Qq = {1, . . . ,/}, = SL for all v G Qo, and ha = M for all a G Qi. 
Recall the construction of the quiver Q*^^^ from Section 4 of [23]. By definition, 
qJ,^^ = {1, . . . , 2/} C N and ^ = {a, | a G Qi, v G Qo, and v < i{v)}, where 
(3'^ = 2v- 1, = 2v, and 

• if i{a') > a' or i{a") > a", then a' = 2a' - 1 and a" = 2a"; 

• if i{a') < a' and i{a") < a", then a' = 2i{a") - 1 and a" = 2i{a'). 
Consider the mixed quiver setting l}'-^'' = {Q^^\n^^\ g^'^\ h^'^\i^'^^), where for all 

(2) (2) 

V G Qo) u & Qq , and 7 G Qg '^^ have 

i^'^\2v - 1) = 2i{y), i^^\2v) = 2i{v) - 1, 

(2) _ (2) _ 
'^2v ~ ''^2v-l ~ '^■vi 

g^^\u) = SL, h^^\-f) = M. 

Denote _ ^(^(2)^^(2)^ ^(2)) g^^^ ^(2) = H{Q^^\n^^\h^^'^). Then 0(2) jg a zigzag 
quiver setting and a generating system of /^[if^^^]*^*^'' is known. The following is the 
statement of Theorem 1 from |23j . 
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Theorem 5 The homomorphism of K- algebras $ : K[H^'^'']'^^ — * K[H]'^ , given by 



$(X/3j = E{n^) for v e Qo, v < i{v), 

X*, ifi{a') < a' and i{a") < a" 
Xn, otherwise 



for a E Qi, is a surjective mapping. 

Lemma 6 For every O.^"^^ -tableau with substitution (D, (Zi, . . . , Zg)) there is a 
0.^-tableau with substitution (T, (Yi, . . . , K,)) such that $^(bpfy(Fi, . . . , Yg)) = 
<l>(bpf^(Zi,...,Z,)). 

Proof. Let {D, {Zi, . . . , Zg)) be 0(^^-tableau with substitution of weight w_ = 
{wi, . . . , W21) and dimension n and let W be the distribution determined by w. 

For every v E Qo the vertex 2v of Q^^) IS a source and i^^\2v) is a sink. Assume 
that W2v 7^ 0. Hence there is an a G -D such that a' or a" lies in W2V The definition 
of a n'-^-'-tableau with substitution imphes a contradiction. Thus W2v = for aU 
V e Qo- 

Let u = . . . ,ui), where = W2v-i for all v G Qo, and let U be the dis- 
tribution determined by u. Note that for any 1 < i < wi + ■ ■ ■ + W21 we have 
W\i\ = 2U\i\ - 1. 

Define a tableau with substitution (T, (Fi, . . . ,Ys)) of dimension ri as follows. 
Define T = {foa | a G -D} and for a E D define (p{ba) = 



7 • 



Consider 7 G Qf^ such that Z<^(a) = and W\a'\= W\a"\ 

If 7 = a for an a G Qi, then define V^(a) = -^a- If < and i{a") < a", 
then f/|a'| = a', U\a"\ = i{a") and we define bj' = a', ba = a", "ba = 'a, 'ba = "a. 
If i{a') > a' or i{a") > a", then U\a'\ = i{a"), U\a"\ = a' and we define ba = a. 

If •y = for V E Qo, v < i{v), then U\a'\ = i{a"), U\a"\ = a'^ for E Qq and 
we define Y^i^a) = X^,, ba = a. 

This describes a H'^'-tableau with substitution (T, (Yi, . . . ,Ys)) of dimension n 
and weight u. Obviously, $^(bpfr(Fi, . . . , F,)) = <l>(bpf^(Zi, ...,Zs)). □ 

Theorem 6 Let Q = {Q,n,g,h,i) be a mixed quiver setting satisfying 

= SL for all v E Qq, and = M for all a E Qi. Then the algebra of 
invariants K[H]^ is spanned over K by the elements $'^(bpf j.(Yi, . . . , Kj)), where 
(T, (Yi, . . . , Yg)) is a O.^ -tableau with substitution. 

Proof. Theorems Hj [5] together with Lemma [6] show that the invariants belong to 
i^-span of the elements from the theorem. Formula ([6]) and Lemma |3] completes the 
proof. □ 
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6.3 Proof of Theorem 2 

Let Qo = {1, • • • , I}- Define g^^^ = {g^^\ . . .,gP) by g^^^ = SL for all v e Qo and 
denote G^^) = G{n,g^^\i). Since G^^) C G, we have K[Hf C Also note 

that = So- 

Let / G be a polynomial of a multidegree t = (ta)aeQi- By Theorem [HI 

/ = E,A,'l>^(bpfT,(>S-,b---,>S-,s,)), where A, G i^, "(T„ (F,- 1, . . . , y,, is a H^- 
tableau with substitution of a weight Wj = {wj^i, . . . ,Wj^i), and the multidegree of 
$^(bpfy^ . . . , Yj^sj)) is t. Lemma [3] together with formula ([6]) and restriction ([3]) 
imply that for any g E G we have 

■ / = J] A,<I>^(bpf^^.(F,,i, . . . , ( n det(^.)--^(^)-- 

j \v&Qo,v<i{v) 

It is not difficult to see that Wj^i(^y) — Wj^^ does not depend on j, therefore we denote 
it by fly. Hence, 

g-f= n det(<7,r-/ = /, 

vGQo, v<i{v) 

and the statement of the theorem follows immediately. 

7 Reduction 

Consider an arbitrary mixed quiver setting = {Q,n, g, h,i) satisfying ([3]). As 
usual, define G = G{n,g,i) and H = H{Q,n,h). 

Definition (of O.^). Let a mixed quiver setting O.^ = {Q^ , , g^ , , i^) and 
a mapping $^ : K[H{Q^,n^,h^)] K[H] be a result of the following proce- 
dure. (Here the letter R stands for the word reduction). Denote indeterminates 
of K[H{Q^,n^, h^)] by x^-, where /3 e Qf, and denote the corresponding generic 

matrix by = (x^). Initially assume that is 13 and for every a G Qi we have 
$'^(Xq,) = Xa. Afterwards we change O.^ and by performing steps a)-c). 

a) For every f G Qo such that g^ is O or Sp we add a new vertex v to and 
set ) = > f , = iT'v, 9^ = g§ = GL. Also we add two new arrows (3^, 
1v to such that /3'^ = v, /3" = U, 7^ = v, 7^' = By definition, if g^ = O, 
then $^(X/3j = $^(X^J = E{ny), otherwise $«(X^J = $^(X^J = J(n,). 
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b) For every v E Qo with = SO we add a new vertex v to and set 
i^{v) =v>v,n§ = riy, = g§ = SL. Also we add a new arrow (3y to 
such that (3'^ = v, /5" = v. By definition, $^(X^J = E{n^)] 

c) Define = M for all /5 G Qf . 

Note that Qo C Q^, Qi C Qf. For short, we write for G{n^,g^,i^) and if^ 
for H{Q^,n^,h^). 

Let ip : G ^ G^ be the natural embedding, where = gv for t> G Qo? and 

ip{g)v = {g^^y for w G Qo with gr„ G {O,^, S'O}. It is not difficult to see that 
g ■ ^^(X/s) = ^^(Hg) ■ Xp) for all ^ G G and p G Qf . Hence 

g . = $^(^(^) . /) (8) 

for all / G K[H^]. Thus $^(/) lies in for all / from K[H^f. 

Theorem 7 The restriction <l>^ : ^ zs a surjective mapping. 

Since a generating system for K[H^]'^^ is known (Theorem [2]), Theorem [7] gives us 
a generating system for K[H]'-^. In order to prove this theorem we need some facts 
from the theory of modules with good filtrations. 

7.1 Good filtrations 

Consider an affine algebraic group G with the coordinate ring a closed sub- 

group B of G, and a rational i?-module A. The tensor product (S> v4 over K is 
naturally a rational GxB module with respect to the action {g, b) ■ (/®a) = /(S'^) i^ba 
hi g e G, b e B, f e K[G], a e A, and (x) = f{g-^xb). The set of 
i?-fixed points of K[G] ® A is a rational G-module, called the induced module 
Indg A = {K[G] ® A)^ (see, for example, |I9|). 

By a good filtration of a rational G-module M we mean an ascending chain 
= Mo C Ml C ■ ■ ■ C M of submodules with Ui^Mi = M and for z > the 
module Mj+i/Mi is either zero or is induced from a one-dimensional module over a 
fixed Borel subgroup of G. 

• An affine G- variety H is called good if its coordinate ring K[H] has a good 
filtration, where, as usual, G acts on K[H] by the rule {g ■ f){x) = f{g~^ ■ x) 
ior geG, f e K[H], and heH. 
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• A pair of affine G- varieties {H2, Hi) such that Hi is a closed subvariety of H2 
given by an ideal /, i.e., K[Hi] = K[H2]/I, is called a good G-pair, if H2 is 
good, and / has a good filtration. 

We list some standard properties of modules with good filtrations (see [9], [25]). 

Theorem 8 a) If 

is a short exact sequence of G-modules and L has a good filtration, then 

is exact. 

b) If M C N are modules with good filtrations, then N/M also has a good filtra- 
tion. 

c) If M, N are G-modules with good filtrations, then M ® N , considered under 
the diagonal action of G, also has a good filtration. 

Corollary 3 // {H2^ Hi) is a good G-pair, then Hi is a good G-module and the 
mapping K[H2]'^ K[Hi]'^ , induced by the natural surjection K[H2] — * K[Hi], is 
also a surjection. 

The following two lemmas will help us to construct good pairs. 

Lemma 7 a) Let M be a GL(n) -module. Then M has a good GL{n) -filtration 
if and only if M has a good SL{n) -filtration. 

b ) Let = Mq C Ml C ■ ■ ■ C = M be an ascending chain of submodules such 
that Mi^i/Mi has a good filtration for any 1 < i < r. Then M has a good 
filtration. 

c) Let M be a Gi X G2-module such that G2 acts trivially on M. Then M has a 
good Gi X G2-filtration if and only if M has a good Gi-filtration. 

d) If{H2,N) and {N,Hi) are good pairs, then {H2,Hi) is a good pair. 

e) If {Hi, Ni) and {H2, N2) are good G-pairs, then {Hi © H2, Ni © A^2) is a good 
G-pair, provided that G acts on the direct sums diagonally. 
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Proof. For parts b), c), d), respectively, see Proposition 1.2a (iv), Proposi- 
tion 1.2e (ii), Lemma 1.3a (i) of [lOj, respectively. Since SL{n) is the derived 
subgroup of GL{n), part a) follows from part (i) of Lemma 1.4 of fl2\ . 

Now we prove part e). Part c) of Theorem [8] implies that K[Hi ©if2] = ® 
K[H2] has a good filtration. We have K[Ni] = K[Hj\/ Ii for z = 1, 2 and some ideals 
1 1. Consider the short exact sequence 



where I = KlH^] + K[H,] h. Since I / h®h = {h<^ KlN^]) © {K[Ni] ® h) 
has a good filtration and Ji ® I2 has a good filtration (see Theorem [HI c)), then / 
has a good filtration by part b). □ 

Denote by Sq^ti) and Si{n), respectively, subsets of S~^{n) consisting of invert- 
ible matrices and of matrices with the determinant 1, respectively. Similarly denote 
by Sq^u) the subset of S~{n) that consists of invertible matrices. Let {1, *} be the 
group of order two, where the symbol 1 stands for the identity element of the group. 
Given j3 G {1, *}, a vector space V = K"^, and g G GL{n), we write 



Lemma 8 a) Let GL{n) act on i^"^"- hy the formula g ■ A = gAg^ for g G 
GL{n), A G iT"^". Then (iT"^", 5+(n)), S^H), {GL{n), S^{n)), 

and {GL{n), Sq (n)) are good GL{n) -pairs. 

b) Let the group SL{n) act on i^"^" in the same manner as in part a). Then 
{S^ (n) , Si (n)) is a good SL{n)-pair. 

c) Let GL{n) act on H = i^"^" © JsT"^" by the formula g ■ (^1,^2) = 
igAig\{g-yA2g~') forge GL{n) and (^1,^2) G H. Then {H,{{Ai,A2) G 
H I A1A2 = E}) is a good GL{n)-pair. 

d) LetV = (K")^ andW = {K"')'^ for e {1,*}. If GL{n) x GL{m) acts on 
M = ~ Hom;^(V, W) in the natural way, i.e., {gi,g2) ■ A = gjA^g^)^^, 
then M is a good GL{n) x GL{m) -module. 

Proof. For part a) see Lemma 1.3 of [33] and its proof. For part c) see the reasoning 
at the end of Section 1 of 133). 



^ / ^ K[Hi] © K[H2] K[Ni] © K[N2] ^ 0, 
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To prove part b) let K[S^{n)] = K[xij 1 1 < i,j < n], where Xij = Xji and 
consider an n x n matrix X = (xij) and an ideal / < K[S~^{n)] generated by 
det(X) - 1. Obviously K[Stin)] = K[S+{n)]/I. A mapping / ^ / ■ (det(X) - 1) is 
an isomorphism of S'L(n)-modules K[S~^{n)] and /. This fact together with part a) 
of this lemma, part a) of Lemma [7] and Corollary [3] imply that S^{n) is a good 
5'L(n)-module and I has a good 5'L(n)-filtration. 

To prove part d) notice that K[M] ~ S{W* V) as GL(n) x G'L(m)-modules 
(for example, see Lemma 1 of [23]). Hence it is enough to show that S^{W* ® V) 
has a good filtration for every r > 0. Consider ABW-filtration for S^iW* ® V) (see 
Section 1.3 of [35] or Theorem 2.4 of [7J). Its factors are L\{W*) ® LxiV), where 
L\{y) denotes a Schur module. The module LxiV) has a good GL(n)-filtration and 
L\{W*) has a good GL(m)-filtration. By part c) of Lemma[7|both of these modules 
have good GL{n) x G'L(m)-filtrations. Part c) of Theorem [8] concludes the proof. 
□ 

We have the following version of Frobenius reciprocity. 

Lemma 9 (c.f. Lemma 8.1 of /7P|/) If G is a closed subgroup of an algebraic group 
C and H is an affine C -variety (i.e. C acts rationally on H), then the algebra of 
invariants {K[H] ® K[C /G])^ is isomorphic to K[H]'^ , where G acts on G /G by 
left multiplication and it acts on the tensor product diagonally. The isomorphism is 
given by the mapping a® f ^ /(lc/G')a for a G K[H] and f G K[G /G\. 

Frobenius reciprocity enables us to reduce investigation of the invariants of G to 
invariants of a bigger algebraic group G such that it is determined by smaller number 
of equations than G and it is more simple to calculate its invariants than invariants 
of G. 

7.2 Proof of Theorem 7 

We split the proof into several lemmas. Let us recall that H = H{Q,n, h) = 

a) Ha = i^^^'X"..", if ha = M; 

b) Ha = S^{na') and Qaf is O or SO, if a' = a" and ha = S~^; 

c) Ha = L^{na') and g^/ = Sp, if a' = a" and ha = L~^', 

d) Ha = S^{na'), *(«') = and ga> is GL or SL, if a' ^ a" and ha = S~^; 
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e) analogues statements are true if we substitute S for in parts b), d) and 
if we substitute L~ for in part c). 

Denote 

a£Qi,ha^L+,L- aeQi,ha=L+ aeQi,ha=L- 

and define the action of G on Hi by 

( -h) =1 da'hagi', iiha^ M and a is a loop 

\ 9a'hag~^, otherwise ' ^ 

where g = {gv)veQo li^s in G, h = {ha)a€Qi li^s in Hi, and a G Qi. As a consequence 
of the following remark the spaces H and Hi are isomorphic as G-modules. 

Remark 1 Let g G Sp{n), A G L^{n), and B G ^^(n). Define the action of Sp{n) 
on L^{n) by g ■ A = gAg~^ and its action on S^{n) by g ■ B = gBg*. Then the 
mapping L^{n) S^{n) given by A AJ is an isomorphism of Sp{n) -modules. 
The assertion remains valid if we replace and S'^ , respectively, by L~ and S~ , 
respectively. 

Rewrite G as G = P x YlG^,, where v ranges over vertices of Q such that 
E {O, Sp, SO}. The group G is a subgroup of 

G = Px Yl GL{n^) Yl SL{n^). 

veQo,g^=0,Sp veQo,g^=SO 

Notice that Hi is also a G-module, where the action is defined by (jH]). Frobenius 
reciprocity (see Lemma [9]) gives the isomorphism 

iK[Hi]0 K[C/G]f - K[Hif. 

Consider the G-module 

Wi= So+K) 5o-K) 

f6Qo,g„=0 v(^Qo,g^=Sp v€Qo,g^=SO 

where SqIu), SqIu), and Si{n) were defined just before Lemma [H Here the action 
is given by 

{g ■ w)y = gvW.,gl for all v e Qq with G {O, Sp, SO], (10) 
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where g E C and w = {wy)veQo,g^£{o,Sp,so} belongs to Wi. The mapping tti : 
C/G ^ Wi given by 

{g is the equivalence class of g E C, v E Qo, and G {O, 50}) is well defined. 

Lemma 10 The mapping tti is a C-equivariant isomorphism of the algebraic groups 
C/G and Wi. 

Proof. Mappings 

GL{n)/0{n) ^ S+{n), g ^ gg' and 

GL{n)/Sp{n) ^ 5(7 (n), g t-^ gjg^ 

are GL(n)-equivariant isomorphisms of the algebraic groups, where GL{n) acts on 
the left hand sides by left multiplication and it acts on the right hand side by the 
formula g ■ A = gAg* (see Lemma 1.2 of [33]). Similarly, a mapping 

SL{n)/SO{n)^St{n), g ^ gg\ 

is an S'L(n)-equivariant isomorphisms of the algebraic groups, where the actions are 
the same as above. This completes the proof. □ 

The space Hi is contained in 

and the space Wi is contained in 

W2= GLK) 5+K). 

v£Qo,g^ is O ov Sp veQo,g^=SO 

Define the action of C on H2 and W2, respectively, by the formulas (Q and (ITOl) . 
respectively. 

Lemmas [71 [H] imply the following result. 

Lemma 11 The C-pair {H2 © 14^2, Hi © Wi) is a good one. 
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We refer to the elements of the space 

v€QQ,g^=0,Sp veQo,g^=SO 

as w = {wy,Wu)y^ueQo,g,Mo,Sp,so},g^&{o,Sp}- Endow W3 with the structure of C- 
module by 

{g ■ w)y = gvW^gl for all v e Qo with G {O, Sp, SO}, 

(g ■ w)u = {g:^ywug~^ for all u e Qo with G {O, Sp} 
for g E C . Define the embedding 

712 ■W2 ^ W3 

of C-spaces by 7!'2{w)y = and 7!'2{w)u = w^^. 

The following lemma is a consequence of Lemmas U\ El 

Lemma 12 The C-pair {H2 © W^, H2 ® t^2{W2)) is a good one. 

Using Corollary [3] together with Lemmas [TOl [TTl [121 ^'^^ Frobenius reciprocity 
(see Lemma [9l) we obtain a surjection 

$ : ir[i72 © W^f K[Hf. 

Consider the mixed quiver setting 0^. Remove each loop a G Qf with ^ M 
and replace it by a new arrow /9o with [3'^ = v, P'^ = v, where a' = a" = v. Denote 
the resulting quiver by Q° and set n° = n^,g^, i^), where hPp = M for all 
13 G Q?. For short, we write for G{n^,g^,i^) and write for H{Q^,n^,h^). 
Denote indeterminates of K[H^] by x^-, where /3 G Q?, and denote the corresponding 
generic matrix by Xjs = (x^). Then C = and G°-modules H2 © W3 and -ff° are 
equal. 

Define a mapping <l>° : K[H^] K[H] by 

{Xa, if 7 = /3a for a loop a G Qi with /i^ G {5*+, 5*"} 
XaJ{ny), if 7 = /3q, for a loop a e Qi with G L"} 
$«(X^), if7eQfnQ0 

for 7 G Q?. It is not difficult to see that the restriction of to G'^-invariants 
coincides with $. 
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Let bpfj.(Yi, . . . ,Ys), where (T, {Yi, . . . ,Ys)) is a H^-tableau with substitution of 
a weight w_, be a G'^-invariant. Then there is a path l}^-tableau with substitution 
{D, {Zi, . . . , Zg)) such that 

$°(bpf^(yi, ...,Ys)) = ^^(bpf^izi, . . . , z,)) 

and the weight of {D, {Zi, . . . , Zg)) is w. (Note that Qq = Qq.) Lemma [3] imphes 
that bpf£,(Zi, . . . , Zg) is a G^-invariant. Theorem [2] together with ([8]) shows that 

C <l>^(ir[/7^]^'') C K[Hf. 
The fact that $ is surjective completes the proof of Theorem [71 

8 Path 0-tableaux with substitutions and good 
O-tableaux with substitutions 

Consider a tableau with substitution (T, (Xi, . . . ,Xs)) of dimension n G N"^ and 
numbers I < qi < q2 ^ m with = Ug^. Let us recall some concepts introduced 
in [2lj. 

Denote by M. the monoid freely generated by letters xi,X2, ■ ■ •, x\,X2, ■ ■ ■ Let 
Aix he the submonoid of A4, generated hj xi, . . . ,Xs, x\, . . . ,xl. For short, we will 
write 1, . . . , s, 1*, . . . , s* instead of Xi, . . . ,Xs,x\, . . . , x*. Given a G T, we consider 
(p{a) G {1, . . . , s} as an element of Mt- 

Given u G Air, define the matrix by the following rules: 

• Xjt = Xj for any 1 < j < s; 

^ ^ _ ( XyXw, if the product of these matrices is well defined 
\ 0, otherwise 
for v,w E M.T- 

For an arrow a eT denote by a* the transpose arrow, i.e., by definition (a*)" = a', 

(a*)' = a", "(a*) = 'a, '(a*) = "a, (^(a*) = (^(a)* G Mr- Obviously, (a*)* = a. 
t 

We write a G T if a G T or a G T. 

i 

Definition (of paths in T). We say that ai,a2 G T are successive in T (with 
respect to gi and ^2), if ct'i, ^2 G {gi, 52}, o'^^ 7^ «2; ''^1 = "'^2- 
A word a = ai ■ ■ ■ a,, with 0,1, . . . , flr 

G T, is called a ^^at/i in T with respect 
to columns qi and 52, if c^i, are successive (with respect to qi and ^2) for 
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any 1 < z < r — 1. In this case by definition (p{a) = (p{ai) ■ ■ -(fiar) G Air and 
a* = a* ■ ■ ■ is a path in T; we denote a^, 'a^, a'/, "ai, respectively, by a', 'a, a", "a, 
respectively. If the columns qi and q2 are fixed, we refer to a as a path in T. A path 
ai • ■ ■ is dosed if a^, ai are successive; in particular, a'/, G {gi, 52}- 

Given ^ G iS„^^ we will also use the notations (T^, (Yi, . . . , y^)) and (T^,Yj,^), 
respectively, for the tableaux with substitutions of dimensions n and d, respectively, 
defined in Section 4 of [24]. Here = {Zi, . . . , Zh) for some matrices Zi, . . . , Zh- 

Throughout this section we assume that O. = {Q,n, g, h,i) is a mixed quiver 
setting satisfying ([3]) and 

g, ^ Sp for all v G Qo- (H) 

Consider an arrow /3 G Qf . If /3 G Qi and h,^ = M, then /5* G Qf is given by the 
definition of a mixed double quiver setting. Otherwise, we set 

_ J a, if P = a*, ha = M, and a E Qi 
^ ^ \ if p e Qi and hp ^ M 

If (3 = (3^ ■ ■ ■ f3^/is a path in Q^, denote by /3* = /3* ■ ■ ■ a path in Q^. Condition 
implies that <I>^(X^* ■ ■ -X^*) = <l>^(Xft. ■ ■ -X^J*. 

Definition (of good 0-tableaux with substitutions). A tableau with substi- 
tution (T, {Yi, . . . , Yg)) of dimension n G N™ is called a good il-tableau with substi- 
tution, if for some weight w = {wi, . . . , wi) G N' and the distribution W, determined 
by w, one has 

• n = ( ni, . .^.,711^ , . . . , n; . ,n;J ); 

UIl Wl 

• if a G T, then there exists a path /? = /?i ■■■/?,. in (where Pi, . . . , Pr £ Qf ) 
such that Y^^a) = "^^{Xp^ ■ ■ -X^J, W\a'\ = i{p"), and W\a"\ = p'. 

Remark 2 a) Any path £l-tableau with substitution is also a good id-tableau with 
substitution. 

b) For every good £l-tableau with substitution (T, (Yi, . . . , K,)) of a weight w there 
is a path O.^ -tableau with substitution (T, {Zi, . . . , Zg)) of weight w_ such that 
for every a E T we have the equality Z^pi^a) = Xp^ ■ ■ ■ Xp^ for a path Pi - ■ ■ Pr 
from the definition. Moreover, bpfj.(Yi, . . . , Yg) = $^(bpfji(Zi, . . . , Zg)). 



A.A. LOPATIN 



34 



Lemma 13 Consider a good £l-tableau with substitution (T, (Yi, . . . , Ys)) of a weight 
w_, that determines the distribution W , and let n G be the dimension of 
(T, (Yi, . . . ,Ys)). Assume that numbers 1 < < ^2 < satisfy i{W\qi\) = W\q2\ 

and b = hi ■ ■ ■ bp (where bi, . . . ,bp E T) is a path in T with respect to columns qi and 

Then there is a path [3 = [3i---[3r in (where Pi, . . . , Pr G Qi) such that 
y^(^) = $^(X^,, ...X^J, W\b'\ = i{p"), and W\b"\ = In particular, if b is a 
closed path in T , then P is a closed path in . 

Proof. Obviously, it is enough to prove the lemma for p = 2. For j G {1,2}, the 

t 

condition bj G T implies that there is an aj G T with bj G {aj, a*}. By the definition 
of a good £}-tableau with substitution, there is a path aj = aj^i ■ ■ ■ aj^rj in 
(where a^-i, . . • , aj,r, e Qf ) such that = $^(Xo^ ,,^, ■ ■■Xa^ ,), W\a'j\ = i{a'^), 

and W\aj\ = a'j. 

Assume bi = oi and 62 = ai- Then {51,^2} = {a'i,ct2}- Define P = a\ai = 
c^ira ■ ■ ■ '^2,i'^i,i ■ ■ ■ "^i-ri = Pi'-'Pri where Pi,...,Pr G Qf, r = ri + r2. Since 
{a\)' = i{a2) = W\a'2\ = i{W\a\\) = a'(, we infer that /? is a path in Q^. Obviously, 

By the definitions of ai, a2, we have W\b'\ = W\b2\ = W^la'gl = = iiP") and 
= 11^|6'/| = W^la'/I = a[ = P' . This proves the claim for the given case. 
The remaining cases can be treated analogously. □ 



Theorem 9 Let = {QjU, g, h,i) be a mixed quiver setting satisfying condi- 
tions Iji^ and ([HP- Let (T, (Yi, . . . , Kj)) be a path 0.-tableau with substitution of 
a weight w_, that determines the distribution W. Then bpf2-(Yi, . . . , Yg) is a polyno- 
mial over K in ^^{ak{Xp^ ■ ■ ■ X^^)) and $-^(bpf^(Zi, . . . , Z^)), where 

1. Pi - ■ ■ Pr ranges over closed paths in QP and 1 < k < ripn; 

2. {D, {Zi, . . . , Zh)) ranges over path O.^ -tableaux with substitutions of a weight 
u such that 

a) for every v E Qo we have < and Wi(^v) — = Ui(^^) — u^; 

b) if Qv GL or SL for v G Qo, then Ui(^) = or = 0; 
Cy' if 9v '^^ G or SO for v G Qo, then < 1 and i{v) = v. 
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Proof. We have that (T, (Yi, . . . , Kj)) is a good H-tableau with substitution of 
weight w. If conditions b) and c) are vahd for u = w, then the statement is trivial. 
Otherwise, there is a t> G Qo such that i{v) ^ i, wa^^) 7^ 0, w^, 7^ or i{v) = v, 
Wv > 2. Consider I < qi < q2 <: m such that W\qi\ = v, W\q2\ = i{v). In 
particular, ■i(iyigil) = W\q2\ and rig^ = = ni(„) = Ug^. Apply the decomposition 
formula (see Theorem 2 from [24J) to the gi-th and the q2-th columns of T. Then 
bpf7,(Yi, ...,Ys) is a polynomial in crfc(F^(c)), bpf^(Zi, . . . , Z^), where 

• c is a closed path in for some ^ G iS„^^ ; 

• {D, {Zi, . . . , Zh)) = (T'^, Yj,^) is a tableau with substitution of dimension d for 
some 71 E Sn ■ 

Here d G is obtained from n by eliminating the gi-th and g2-th coordinates. 

Applying Lemma [13] to paths of T'^, we obtain that {T'",Yf^) is a good £2-tableau 
with substitution. Lemma [T^ also imply that (Jk{Yyp(c)) = (^ki^^i^Pr ' ' ' -^Pi)) = 
^^{ak{Xf3^ ■ ■ ■ XfsJ for a closed path /5i ■ ■ - /^^ in Q^. 

Repeat this procedure for {D, {Zi, . . . , Zh)) and so on. Finally we see that 
hpfrpiYi, . . . , Ys) is a polynomial in <l>'^(crA:(-^/3r " " ' Xp^)) and bpf£i(Zi, . . . , Zh) such 
that condition 1 is valid and {D, {Zi, . . . , Zh)) is a good H-tableau with substitution 
of a weight u satisfying a), b), and c). Part b) of Remark [2] completes the proof. □ 



9 Proof of Theorem 1 

Consider a mixed quiver setting = {Q,n, g, h,i) satisfying ([3]). As usual, define 
G = G{n,g,i), H = H{Q,n, h). In Lemma |4] we have shown that the elements 
from Theorem [1] are invariants. 

Successive applications of Theorem [7] and Theorem [2] yield the generating system 
that consists of images of hpirp{Yi, . . . ,Ys) for some tableaux with substitutions 
(T, (Yi, . . . , Yg)). Application of Theorem [9] to bpf j.(Yi, . . . , Yg) gives the mixed 
quiver setting, which we denote by £f = (Q'^ , -nf , , h'^ , i^) , and the mapping $° : 
irfi/O] ^ K[H], where stands for H{Q°, n°, such that 

Q'o = Qo = Qo Y[{v \veQo,g,e {O, Sp, SO}}, 

Qi = Qi I « e Qo} (yl\ve Qo, v < i{v)} 
Y[{P,, Pl\ve Qo,g, G {O, Sp, SO}} ]J{7., il\v e Qo,g, e {O, Sp}}, 
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iO( . _ \ iiv), if 9v e {GL, SL} 

* ^''^ ~ \ V, if e {0, 3p, SO} ' "^^^'^ ^ 

o° - fl° - / ^ ^' where v G O 



hl^M for all /3 e Q?, and n° = n 

Here go from i^{v) = v to v, arrows 7„,7* go in the opposite direction (i.e. 

from vtov), and a^, a* are loops in f , respectively. Denote indeterminatcs of 

K[H'^] by for (3 E Qi and denote the corresponding generic matrix by = i^ij)- 
The mapping $° is determined by 



if g^ is O or SO 
J, if = ^ 



= X, for a G Qi, 

= xl for /? e g°. 

The algebra of invariants K[H]^ is generated by the elements $°(bpf j.(Yi, . . . , Yg)) 
and $°(crjt(X^^ • • -X^J), where 

• (T, (Fi, . . . , Fs)) is a path 0°-tableau with substitution of a weight u, satisfying 
the conditions 

a) if g^ = GL {v e Qq), then u^o^^^ = = 0, 

b) if gr° = SL {v e Qq), then UjO^^^^ or -u^ = 0. 

• 7i • • • 7r is a closed path in 1 < k < n°//. 

Lemma 14 Let 7 = 71 ■ ■ ■ 7^ 6e a path in Q° anc? X — ■ ■ ■ X^J. 

//X not a matrix over K , then there is a path (3 — Pi - ■ ■ (3p in such 
that X = ±$^(X^p • • • ^/3i) and 

y, ^fi^Qo n„_\ 7", ^fi'&Qo 
/n particular, if 7 is closed, then (5 is closed. 
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b) If X is a matrix over K, then there is a v G Qo such that 7j',7f G {v,i (v)} 
for any 1 < i < r. Moreover, 

if is GL or SL, then for any 1 < i < r an arrow is a loop; 
if 7^ Sp, then X = ±E, otherwise, X is ±E or ±J. 

Proof, a) Eliminate arrows a^, a\ from the path 7 and obtain a path in Then 
ehminate arrows 7^, 7* to get the required path. To prove it, see the following 

pictures, where we depicted some vertex f G Qo with g^ G {O, Sp, 5*0} and two 
arrows ai, 0:2 G Q\. 




b) This case is trivial. □ 

The last lemma shows that we can reduce £3° to a mixed quiver setting £3^ = 
{Q^,n^,g^,h^,i^), which almost coincides with £3^. To do so, define Ql = Qq = 
Qo and Q\ = Qf . . . , 5^}, where 6i is a loop and g > 0. Then consider a 

mapping $1 : K[H{Q°, n^, ^ K[H] such that 

if /3 G Qo, then ^\Xfs) = $^(X^), otherwise $^(X^) is ± E or ± J, 

and assume that for every path 0°-tableau with substitution (T, (Yi, . . . , K^)) sat- 
isfying the property formulated before Lemma [H] there is a path H^-tableau with 
substitution (T, {Zi, . . . , Zg)) satisfying 

a) $0(bpfr(yi, . . . , n)) = ±^\hpfAZu • • • , ^s)); 

b) if the weight of (T, (Yi, . . . , Yg)) is m, then the weight of (T, (Zi, . . . , Zg)) is w, 
where for every f G Qo we have 

_ J u^, if gi^ is GL or 
" \Mt, + M^7, if g^ e {O, Sp, SO} 

Consider a vertex f G Qq. There are three possibilities. 

• If g^, G {GL, O, Sp}, then equalities = w„ = imply that Si is not a loop 
in f for all i. 
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• If g^; is SL, then, since Wy = or Wi^^) = 0, we see that 6i is not a loop in v 
for all i. 

• Let be SO and let 5j be a loop in t> for some i. Then ^^(X^.) = ±E. 
Theorem M together with the facts 

a) bpf'p(Fi, . . . , Ys) = for any tableau with substitution (T, (Yi, . . . , Yg)) 
with V^(a) = E and a' = a" for some a E T; 

b) every H^^-tableau with substitution, where Q.^^ is a mixed double 
quiver setting of H^, is also a path H^-tableau with substitution; 

completes the proof. 



Acknowledgements. This paper was written during author's visit to University 
of Antwerp, sponsored by Marie Curie Research Training Network Liegrits. The 
author is grateful for this support. The author would also like to thank Fred Van 
Oystaeyen for hospitality and Alexander Zubkov for his generous help in proving of 
Theorem [71 



References 

[1] S.A. Amitsur, On the characteristic polynomial of a sum of matrices, Linear 
and Muhilinear Algebra 8 (1980), 177-182. 

[2] H. Aslaksen, E.-C. Tan, C.-B. Zho, Invariant theory of special orthogonal 
groups, Pac. J. Math. 168 (1995), No. 2, 207-215. 

[3] H. Derksen, J. Weyman, Semi-invariants of quivers and saturation for 
Littlewood-Richardson coefficients, J. Amer. Math. Soc. 13 (2000), 467-479. 

[4] H. Derksen, J. Weyman, On the Littlewood-Richardson polynomials, J. Algebra 
255 (2002), No. 2, 247-257. 

[5] H. Derksen, J. Weyman, Generalized quivers associated to reductive groups, 
Colloq. Math. 94 (2002), No. 2., 151-173. 

[6] M. Domokos, Invariants of quivers and wreath products. Comm. Algebra 26 
(1998), 2807-2819. 



A.A. LOPATIN 



39 



[7] M. Domokos, A.N. Zubkov, Semi-invariants of quivers as determinants, Trans- 
form. Groups, 6 (2001), No. 1, 9-24. 

[8] M. Domokos, P.E. Prenkel, Mod 2 indecomposable orthogonal invariants, Adv. 
Math., 192 (2005), 209-217. 

[9] S. Donkin, Rational representations of algebraic groups: tensor products and 
filtrations. Lecture Notes in Math. II40 (1985), Springer, Berhn, Heidelberg, 
New York. 

[10] S. Donkin, The normality of closures of conjugacy classes of matrices. Invent. 
Math. 101 (1990), 717-736. 

[11] S. Donkin, Invariants of several matrices. Invent. Math. 110 (1992), 389-401. 

[12] S. Donkin, On tilting modules for algebraic groups. Math. Z., 212 (1993), 39-60. 

[13] S. Donkin, Polynomial invariants of representations of quivers. Comment. 
Math. Helvetici 69 (1994), 137-141. 

[14] Yu.P. Drozd, V.V. Kirichenko, Finite dimensional algebras. Springer- Verlag, 
1994. 

[15] E. Formanek, The invariants ofnxn matrices. Lecture Notes in Math., 1278 
(1987), 18-43. 

[16] E. Formanek, The polynomial identities and invariants of n x n matrices. Re- 
gional Conference series in Mathematics, 78, Providence, RI; American Math. 
Soc, 1991. 

[17] P. Gabriel, Unzerlegbare Darstellungen I, Manuscr. Math. 6 (1972), 71-103. 

[18] F.R. Gantmacher, Theory of matrices, (2nd ed.) Moscow, Nauka, 1966 (Rus- 
sian). French transl.: Paris, Dunod, 1966. 

[19] F.D. Grosshans, Algebraic homogeneous spaces and invariant theory, Lecture 
Notes in Math. 1673 (1997), Springer, Berlin, Heidelberg, New York. 

[20] W.V.D. Hodge, D. Pedoe, Methods of algebraic geometry. Vol. I, Cambridge, 
Univ. Press, 1947. 

[21] W.V.D. Hodge, D. Pedoe, Methods of algebraic geometry. Vol. II, Cambridge, 
Univ. Press, 1952. 



A.A. LOPATIN 



40 



[22] L. Le Bruyn, C. Procesi, Semi-simple representations of quivers, Trans. Amer. 
Math. Soc. 317 (1990), 585-598. 

[23] A.A. Lopatin, A.N. Zubkov, Semi-invariants of mixed representations of quiv- 



ers, to appear in Transform. Groups, arXiv: |math.RT/0512651 



[24] A.A. Lopatin, On block partial linearizations of the pfaffian, to appear in Linear 
Algebra AppL, arXiv: math.RA/0608747, 

[25] O. Mathieu, Filtrations of G-modules, Ann. Scient. Ec. Norm. Sup. (2) 23 
(1990), 625-644. 

[26] C. Procesi, The invariant theory of n x n matrices. Adv. Math. 19 (1976), 
306-381. 

[27] Yu.P. Razmyslov, Trace identities of full matrix algebras over a field of charac- 
teristic 0, Izv. Akad. Nauk SSSR Ser. Mat. 38 (1974), No. 4, 723-756 (Russian). 

[28] D.A. Shmelkin, Signed quivers, symmetric quivers, and root systems, J. Lond. 
Math. Soc, IL Ser. 73 (2006), No. 3, 586-606. 

[29] K.S. Sibirskii, Algebraic invariants of a system of matrices, Sibirsk. Mat. Zh. 9 
(1968), No. 1, 152-164 (Russian). 

[30] A. Schofield, M. Van den Bergh, Semi-invariants of quivers for arbitrary di- 
mension vectors, Indag. Math. (N.S.) 12 (2001), No. 1, 125-138. 

[31] H. Weyl, The classical groups — their invariants and representations, Princeton 
Univ. Press, Princeton, N.J., 1946. 

[32] A.N. Zubkov, A generalization of the Razmyslov-Procesi theorem. Algebra and 
Logic 35 (1996), No. 4, 241-254. 

[33] A.N. Zubkov, Invariants of an adjoint action of classical groups. Algebra and 
Logic 38 (1999), No. 5, 299-318. 

[34] A.N. Zubkov, The Razmyslov-Procesi theorem for quiver representations. Fun- 
dam. Prikl. Mat., 7 (2001), No. 2, 387-421 (Russian). 

[35] A.N. Zubkov, Invariants of mixed representations of quivers I, J. Algebra AppL, 
4 (2005), No. 3, 245-285. 



A.A. LOPATIN 



41 



[36] A.N. Zubkov, Invariants of mixed representations of quivers 11: Defining rela- 
tions and applications, J. Algebra AppL, 4 (2005), No. 3, 287-312. 



